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Some current theorizing about inr^nal and external, digital and 
analogue representational systems was reviewed. The possibility that there 
are two, overlapping internal analogue representational systems, one for 
organismic states and the other for external world dimensionalities and objects 
was considered. The concept of a working memory, or "mind's eye", and its 
importance in learning was described. Some conceptions of how this might 
serve In the generation of mental imagery from digital propositional 
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information scored in long-term memory were noted. 

Some research bearing on the use of external imagery for facilitating 
learning and improving retention was reviewed. A project to use the 
Plato IV system for automatically running subjects and collecting and 
analyzing data anywhere in the Plato XX network was described. Illustra- 
tions of how the plasma panel display and the touch panel is used for 
interactive, animated computer graphics to illustrate invisible processes 
were presented. Description of the experimental design in detail, and 
results of the first study will be presented in a subsequent report. 
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ABSTRACT 



Some current theorizing about internal and external, digital and 
analogue representational systems was reviewed. The possibility that 
there are two, overlapping internal analogue representational systems, 
one for organisraic states and the other for external world dimensionali- 
ties and objects was considered. The concept of a working memory, or 
"mind's eye", and its importance in learning was described. Some concep- 
tions of how this might serve in the generation of mental imagery from 
digital prepositional information stored in long-term memory were noted. 

Some research bearing on the use of external imagery for facilita- 
ting learning and improving retention was reviewed. A project to use the 
Plato IV system for automatically running subjects and collecting and 
analyzing data anywhere in the Plato IV network was described. Illustra- 
tions of how the plasma panel display and the touch panel is used for 
interactive, animated computer graphics to illustrate invisible processes 
were presented. Description of the experimental design in detail, and 
results of the first study will be presented in a subsequent report. 
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I* REPRESENTATIONAL SYSTEMS 



Attneave (1974) reminded us that the world as we know it is an 
internal representation created by our brains, and that language is an 
elaborate external representational system for communicating among 
brains. He divided ail representational systems, both internal a&l 
external, into two categories: analogue processes and digital processes. 
Education and training involve manipulating external representational 
systems to influence internal representational systems in ways that 
will support predictable behavior in prescribed situations. In Attneave 9 a 
terms, this would be behavior that demonstrates that the student knows 
how to change situation Into situation $ 2 *>y doing R: Sj, R*S 2 « 

With the growing availability of interactive graphics terminals for 
use in computer-aided instruction, the differential uses of external 
analogue (graphic) or digital (alphanumeric) representational systems in 
educational and training processes will require better definition. Ana- 
logue representations that can interact with the student are unique to 
these terminals. With a light pen or a touch panel, the student can res* 
pond to changes in elements of a figure or cause elements in a figure to 
be changed* This is quite a different capability than merely changing 
the sequence of slides, film strips, or TV frames. The prescriptions for 
mixing verbal and graphic representations in these media, though useful, 
are inadequate guides here* 

The relative effectiveness of alphanumeric versus graphic displays in 
communicating efficiently, facilitating learning, and promoting long-term 
retention should receive more investigation. 



Current Conceptions of Internal Representational Systems 

This discussion can be no more than a brief characterization of 
major areas, leaving aside any attempt to review the extensive litera- 
ture concerning the organization of memory and cognitive processes. 
The intent is to summarize and to highlight a few issues of Importance 
to the current study* 

theorists currently hold that information in long-term memory is 
organized in a relational network. Several differing specifications of 
possible organizations can be found in Collins and Quiliian (1969), 
Rummehart, Lindsay, and Norman (1972), Tulving and Donaldson (1972), and 
Anderson and Bower (1973). Storage of information in long-term memory 
modifies or adds to the relational network. Retrieval from long-term 
store involves searches, either in parallel or in serial fashion, among 
9 "pathways" connecting nodes in the relational system. 

All this is highly speculative; in intelligent adult humans, little 

is known about storage and retrieval processes and relational networks , 

# 

which must be overwhelmingly vast and complicated. Futhermore, some 
theorists seem to be suggesting that this is dynamic storage and that oper- 
ations on the relational network may be going on all the time at pre conscious 
levels (Singer, 1974). Other theorists suggest semantic organization 
changes dynamically according to the context (Anderson and Or tony, 1973). 

Perhaps it is partly a Chomskian influence, that theorizing about 
the structure of long-term memory has been done mostly in terms of seman- 
tic characteristics 'of language. The models of long-term memory described 
in the above references are essentially "language understanders ." In humans, 
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this must be a major function of long- term memory* Understanding lan- 
guage seems to depend upon comprehending first the context in which the 
language occurs* then the instructions inherent in the syntax of the 
sentences, which function to delimit the search patterns to be used ; 
then directed retrieval from (or stimulation of?) appropriate parts of 
the relational network, and formulation of some option for responding. 

Language plays a pre-eminent role as an external representational 
system, being particularly suited to communicating the concepts and other 
abstractions that are the basis for human societies* If this is so, then 
what do the external analogue representational systems contribute? Do the 
functions of the two kinds of systems overlap in long-term memory? 

Some theorists (e<g«, Anderson and Bower (1973) and Pylyshyn (1973)) 
maintain that the structure of long-term memory is prepositional and that 
it can he used to generate either images or words and can accept inputs 
of either images or words with more or less equal facility* These theor- 
ists described mechanisms whereby such translations could be mediated; they 
contend that perceptual descriptions are stored as inferential conclusions 
and that "the only difference between the internal representation for a 
linguistic input and a memory image is detail of information 91 (Anderson 
and Bower, 1973, p. 460). Leeuwenberg (1971) developed a descriptive lan- 
guage for representing tridimensional visual forms that is reversible. 
The descriptions can be used as instructions for regenerating the forms. 

Experimental support for the notion that long-term memory is preposi- 
tional includes a study showing that subjects store and remember only the 
salient features and perceptual interpretations of scenes rather than the 
raw, detailed representations of sensory information, Wiseman and Neisser 
(1971) found that complex visual pictures (unstructured blobs of ink) art 



remembered v only if the subject interprets the picture — the subject "sees" 
something In the picture*. If the picture was not interpreted during a 
study period, the subject will not recognize the raw picture during a test 

« 

trial. The findings of Chase and Clark ($972) also favor the prepositional 
hypothesis. Their studies on reaction time r.o verify sentences against 
pictures indicate that the sentence and picture must be represented in a 
* common format for comparison and that the format must be prepositional in 
nature. Another basis of support for the prepositional hypothesis of 
memory may he the demonstrated effectiveness of "interactive" imagery in 
paire<f^associate learning. A number of studies have shown that a mediating 
image is facilitative if it involves an i nterac t iofCbe tween the to-be-asso- 
ciated items (see Table 1 in the Appendix) . One study defined several 
types of interactive .imagery and tound that the most facilitative type 
is that which achieves maximum figural unity of the two elements (Lipptnan 
and Shanahan, 1973). When the critical element of interaction is omitted 
and items are shown in a non- interactive and separate imaginal space, the 
benefit of imagery as an associative aid is greasly reduced or lost alto- 
gether (Bower, 1970; Bernback and Stalonas, 1973; Neisser and Kerr, 1973). 
According to the prepositional theory, the interactive image provides a 
single proposition diTectly linking the two items to be associated whereas 

< 

a non- interactive im4ge affords no such direct link., thus making recall 
more difficult. 

Still, it is clear that external digital and analogue representational 
systems do have many differing representational functions. Also, analogue 
sentation of internal states and of the diuiens ionality of the external 
world would seem to be a fundamental function of parts of the nerVous 
system, Attneave (1974) made this requirement clear, when he spoke of 



"a tridimensional analog model of physical space," and when he cited 
evidence from the experimental literature; Shepard and Metzler 's (1971) 
and Cooper and Shepard 's (1973) studies of reaction times for rotating 

mental images; Stevens, Mack and Stevens' (I960) finding that handgrip 

j 

force "tracks" changes in intensities in sensory modalities; and Corbin's 
(1942) and Attneave and Block's studies of the relationship between 
physical separation of two lights and their apparent movement* 

Also, the physiological psychologists' commonly speak of right and 
left hemisphere tasks, based on evidence that at least some of the neural 
systems for information processing are different for analogue and for 
digital information processing tasks. Miiner's studies of patients with 
brain lesions revealed that patients with lesions in the right temporal 
lobe shoved marked deficits in visual memory compared with patients having 
lesions in the le£t f frontal, or parietal regions (1968). 

These and similar studies suggest that the right hemisphere of the 
brain Is responsible for tasks performed poorly by individuals with damage 
to the right brain region. But discovering the activities of the two 
hemispheres by comparing the disabilities due to injury of one side or 
the other has serious shortcomings as Nebes (1974) has noted* When com- 
paring the performances of patients with damage to one or the other hemis- 
phere, difficulties arise in matching the groups for size and locus of 
injury, age, sex, and pre- injury intelligence, Semmes (1968) points out 
that perhaps both hemispheres are equally proficient in performing a task, 
but the neural substrate involved is more focal ly organized in one hemis- 
phere than in the other so that limited damage to that hemisphere will be 
more apt to produce a severe deficit causing that side of the brain to 
appear as ii it wire responsible for the capacity being tested, 

O 
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A rau re powerful line of research has been conducted using subjects 
whose brain hemispheres have been (partially) surgically disconnected so 
that each hemisphere can be examined independently on the same task. 
Such "split-brain" patients make ideal subjects for the investigation of 
lateralization of brain function because it is possible to restrict a 
stimulus to just one hemisphere by presenting physical stimuli to just one 
side of the body or visual stimuli to one visual field for a duration too 
short to allow eye movements * Several researchers have found that subjects 
can correctly name words presented to the right visual field (which con- 
nects with the left hemisphere) hut not words presented to the left visual 
field (which connects with the right hemisphere) although they can retrieve 
the item named with the left hand yet still not be able to verbalise its 
name (Gazzaniga, 1967; Sperry, 1968; Bogen, 1969; Nebes, 1974). But the 
right hemisphere outperforms the left in perceiving and remembering stimu- 
li which either have no verbal labels or are too complex to specify In 
words. These findings add to the evidence that verbal processes are con- 
trolled by the left hemisphere while spatial-imaginal processes are con- 
trolled by the right side of the brain. 

In addition to the evidence from behavioral studies, there is some 
physiological support for the notion that there is hemispheric specializa- 
tion. Calloway and Harris (1974) developed a statistical measure of EEG 
coupling between cortical areas that revealed shifts between right and 
left hemisphere associated with shifts between graphics processing and 
language processing tasks • 

It seems likely that there coujd be two Interrelated analogue repre- 
sentational systems in the brain. These systems presumably function in 
real time, like an analogue computer. One would be functionally similar 
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to a hierarchically-organized system of negative- feedback control loops 
and would be concerned with continually tracking and modulating inter- 
nal states, from muscle tensions to drive states (Powers, 1973). the 
other would generate Attneave's .tridimensional analogue model of physical 
space, which would represent the dimensionality of the external world 
and the organism's position in it. It would seem that this representa- 
tional systemalso would require feedback loops for adjusting its repre- 
sentations. Indeed, feedback loops are found in many places in the ner- 
vous system. There a 'so are |" feed forward" loops to sensory receptors, 
which leads to speculations about the significance of central control 
over sensory systems. Here, there is a broad range of phenomena to 
speculate about, from adjustment of muscle -spindle tension reference sig- 
nals to deCroot's master chess players who could reconstruct chess posi- 
tions perfectly after looking at the board for only five seconds (deGroot, 
1966), and central control over perceiving chimerical images (Nebes, 1974) 
It may be that the internal analogue representational systems provide 
the real-time substrates of information upon which the internal digital 

representational system operates, perhaps by time sampling, to create 

\ 

abstractions that are more economically stored in propositional form in 

\ 

long-term memory. The digital representational system could be directed 
to look "inward," represented by the current outputs of one analogue sys- 
tem, or "outward," represented by the outputs of the other. But, it \ 
clear iy is more complicated than this. The head is full of fe hosts. Some 
of these can be called up at will as daydreams, and some appear, unbidden, 
to haunt our sleep. There must be a "mind's eye" where we can imagine 
things not present, with the internal model o£ the real-time, tridimension 
al external world not continually pre-empting the focus of attention. 



This "working memory" may be where Che mental imagery chat is the 
subject of much recent research occurs « And it may be there that some 
kind of propositions! language of the brain could use digital abstrac- 
tions retrieved from long-term memory for creating analogue mental 
images* This appears to be what Attneave (1974) had In mind with his 
diagram, and his description of the diagram* reproduced below 
<p, 497, 1974) . 




Figure 2. Outline of a system for achieving 
economical representations. 



Figure I. Attneave 9 s outline ot a system for achieving 
economical representations* 



An arrangement of this sort is suggested in Figure 2. On 
the /left, we have a tridimensional modeling Medium, in which 
any representation consistent with the stimulus constraints 
migj t he constructed. This representation is described in the 
center box in Figure 2, and if it changes from one moment to 
the next, any. resulting change in the complexity of the 
description is then fed back as a hot-cold signal into the 
tridimensional system, thereby guiding it into a si m p les t 
representation as a stable state. This is essentially a 
hill' climbing machine, and the analogue medium provides a 
smooth terrain, so to speak, for the hill climber to operate on. 

An analogue stage like this also makes a great deal of 
sense in terms of the identification or categorizing of objects, 
because the descriptive machinery is, taking its descriptions, 
or its defining features of objects, not from the flat picture 
on the retina but from a model of the tridimensional world. 
It is describing solid objects rather than plane projections 
of the objects. 



Thi^ orings up the business of imagination and images, and 
I would like to suggest that this tridimensional modeling medium 
can be used not merely to represent the current input but also 
to represent images that are taken from memory, that is, that 
imaginary scenes can be reconstructed in s pace and~~tha t the or- 
ganism can then proceed to use this as a work space in which he 
tries out things and sees what happens. He can engage in 
vicarious manipulation; he can engage in vicarious locomotion. 
He can try out the results of particular forms of behavior 
before he commits himself to them in practice. This highly 
developed facility for handling spatial information may be used 
in various ways. Consider, for example, the popularity of 
graphs, in psychology and other sciences, in which nonspatlal 
continue are mapped onto spatial coordinates in order to make 
functional relationships more easily apprehended. 

Now, if images in this space can be generated from memory, 
the question immediately arises, In what form. do they exist 
in memory? We might suppose, of course, that they are stored 
in an image like, or picturelike, form. Alternatively, we could 
suppose that they are stored as languagelike descriptions, which 
are reversible in the sense that images can be reconstructed from 
them. 

(pp. 497, 498) 

The capability to use this work space to try out things and to see 
what happens, or to judge the reasonableness of new information in terms 
of the relational network in long-term memory, must be of fundamental im- 



portance in learning. Suppose that this mind's eye is being used to 



image S^, vicariously try out R, and to image S^i in Attneave 1 s terms, 
to implicitly try out "knowing how." If the student had not learned 
how to make S 2 follow Sj, he would fail on that "trial." He would have 
tp get more information somewhere; from long-term memory, or from the 
external world. And, he might run back over the failed trial again in 
his mind's eye, trying to guess what he did wrong or what he should do 
next, in the early stages of learning he would not have enough propoai- 
tional material stored in long-term memory to use to create valid mental 
imagery for S l# or for R, or for $ 2 ; or, perhaps his working memory could 
not hold enough information to allow him to operate effectively. The 
educational strategy is to simplify the task in some way: to break it 
down into small steps, to provide advance organizers, to use familiar 
analogies, to give rules. Eventually, after some number of trials, the 
student is able to do more of the task "in his head.?' Control is trans- 
ferred from external to internal instructions and from external content 
mediators to internal mediators. 

It would seem that, during learning, the tridimensional modeling sys- 
tem functions to represent the real-time external world, and to provide 
a working memory where mental images may be created and would be operated 
upon (Hayes, 1973). The external world representation would serve as a 
source of information, instructions, and feedback to modify mental images 
and operations until the student could make S 2 follow Sj with acceptable 
regularity. The working memory would serve for Imaging situations, for 
formulating operations, and for self-testing. 

What happens between unsuccessful trials and successful trials, how 
do many subskills become integrated into higher level performance, and how 
do over learned tasks become automatized? Learning phenomena like these 
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may someday be explainable in terras of representational and control 

systems In the nervous system. LaBerge and Samuels (1974) described 

an information-processing model of intermediate stages in learning to 

reai. According to this conception, visual information is 

. . . . transformed through a series of processing stages involving 
visual, phonological, and episodic memory systems until it is 
finally comprehended in the semantic memory system. The process- 
ing which occurs at each stage is assumed to be learned and the 
degree of this learning is evaluated Kith respect to two criteria; 
accuracy and automatic ity. At the accuracy level of performance, 
attention is assumed to be necessary for processing, at the 
automatic level it is not. 

(P. 293) 

i 

They assumed that humans can process many things at a time, so. long 
as only one requires attention. During learning, different component 
subskills are learned one at a time to criteria of accuracy, requiring 
that the learning of each be in the focus of attention. As learning a 
aubskill approaches the level of automaticity, its performance requires 
leas attention. Somewhere near this second stage is the time to have the 
student start blending the subskill with a second one. Selective atten- 
tion in this model is viewed as an indispensable process during learning 
that can "selectively activate codes at any level of the system, not only 
at the deeper levels of meaning but also at visual and auditory levels 
near the sensory surface." (LaBerge and Samuels, 1974, p. 295) 

It remains somewhat unclear how subskill learning progresses to a 
stage of automaticity, where performance of the subskill requires little 
or no attention. Perhaps that elucidation will come from the area of 
control theory. Power's (1973) speculations about the organization of the 
brain as hierarchical, negative feedback loops stimulate further specula- 
tion along these lines. Higher levels of control may be reserved for 
coping with unfamiliar events, of which new subskills to be learned are 
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examples. Once Che system discovers the settings of reference signals 
to set into comparators for successively lower levels of control loops 
so as to null out error signals, control over performance can become 
automatic; i.e., the functioning of lower levels does not require con- 
tinual adjustment, this would seem to require a sort of successive approx- 
imations approach to finding these settings, and to require that a high- 
er ^ievel, perhaps the level at which attention resides, engage in per- 
forming these successive approximations up and down the hierarchy. It 
may be a matter of programming Into the comparators a particular pattern 
of reference settings for that particular class of control operations 
demanded by the exemplar subs kill. These settings might be part of what 
is stored in long-term memory (in the cerebellum for motor skills) and 
is used to reconstitute the performance of the subskill at later times. 

These speculations lead to others about the differences between 
classical conditioning and the kinds of eognltively controlled, everyday 
learning characteristic of humans and other higher animals. It is tempting 
to think of classical conditioning as involving mostly the internal, real- 
time, analogue representational systems and very little of the digital; 
there is a "real-time" flavor about classical conditioning, with its very 
short time-coupling between CS and UCS; and to think of it as involving 
primarily lower organizational levels in the CNS. Perhaps, the elabora- 
tion of internal digital representational systems is a fairly recent evolu- 
tionary development that adds digital control not necessarily always 
closely coupled to real-time events, to older analogue levels. 
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II # RESEARCH ON ANALOGUE REPRESENTATIONAL PROCESSES 
IN LEARNING AND MEMORY 



Here, again, the objectives are to summarize at very general levels 
and to consider particular issues relevant to the current study* There 
is | by now, a large body of literature documenting research on mental 
imagery. A reasonably up-to-date categorisation and bibliography of 
this literature is included in the Appendix. The results of such of this 
research have been reviewed by Sower (1972), Paivio (1969) , Harks (1972) 
and others. The findings concerning imagery are essentially that 1) image- 
evocation as a stimulus attribute is positively correlated with the 
material's learoabllity, 2) humans differ in mental imagery ability, with 
"good imagers" performing better on some tasks than poor imagers, and 
3) inducement to use mental imagery as a mnemonic device) aids recall. 

Image-evocation as a stimulus attribute refers to the degree of con- 
creteness of the stimulus materials; it ranges from concrete words, with 
high imagery value, to abstract words at the low end of the scale. The 
studies listed in Table 1 of the Appendix offer support that there is 
learnability-ordering from abstract words to concrete words. However, 
recent research by Morris and Reid (1974) questions the assumption of 
Paivio and others that differences between high I and low I words are due 
to the differential arousal of imagery. Rather, Morris and Reid conclude 
from their experiment that better recognition of high I words than low I 
words is caused by "greater semantic similarity and perhaps associative 
rolatedness among low I than among high I words # ,f 

The superiority of visual memory to linguistic memory has been well 
demonstrated. Loftus (1972) reviewed a number of such studies. Some 
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concluded that long-term recognition memory for pictures is remarkably 
good (Shepard, 1967; Nickerson, 1964; Haber, 1970). In a later study , 
Erdelyl and Becker (1974) found hyperkinesia for pictures, but not for 
words* on multiple recall trials t for most of their subjects. & few of 
their subjects did obtain net recoveries of word items over trials. 
These S f s, it was found during post-experimental interviews, had tried 
to 1 Visualize" or form "mental images" of word items during input and 
retrieval phases. The majority of &*& 9 on the other hand, had tried to 
form conceptual clusters, (semantic networks) of the items based on 
meaningful categories. 

Loftus concluded from his review of the memorability literature that 
recognition memory for pictures may be far from perfect under some cir- 
cumstances. For example, Potter and Levy (1969) found that recognition 
accuracy ranged from 15% for exposure times (study times) of 125 msec, to 
over 90% for 2 sec* 

Loftus attempted, in a series of studies, to specify some of the 
major variables affecting memory for pictures in terms of how these 
variables regulate the encoding processes carried out by a person at the 
time he originally views the picture, Loftus found that number of fixa- 
tions (NF) while a picture is being viewed is a strong predictor of sub- 
sequent accuracy of recognition performance. Furthermore, number of fixa- 
tions during viewing modulated the effects of other variables; e#g#, differ- 
ential pay-off values of paired pictures, and amount of viewing time. 
Loftus also found that requiring the subjects to count backward while 
viewing a picture reduced the fixation rate, and resulted in a recognition 
performance decrement that was greatti than would have been predicted 
from NF alone. 
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Number of fixations when viewing a picture seems to be analogous to 
number of rehearsals for verbal learning. This suggests that active 
processing of a picture improves recognition memory for the picture, and 
that the reason for processing, e.g., high payoff value, will in fact 
influence Che amount of processing (NF) that is done. 

Results of Rock, Halper, and Clayton's (1972) studies in perception 
and recognition of complex figures suggest a similar conclusion. They 
found that 5's tended not to remember nuances of complex figures seen 
only once, but did later recognize the global shapes of these figures. 
Varying exposure times from 2 sec. to repeated exposures did not change 
this result: "Neither prolonged nor repeated exposure to the complex 
figure alters the fact that inner configuration fails to establish a mem- 
ory trace adequate enough to mediate recognition in a test which occurs 
only seconds after the exposure" (p. 663). It is likely that, in the tasks 
given the S's, there was no reason to process details of these nonsense 
figures. 

These studies suggest that merely showing students graphic displays 
would not be very effective. Their attention must be directed to those 
features that are supposed to convey information about the subject-matter, 
and there must be reasons for processing this information. 

Experimental manipulations which caused the subject to create his 
own contextual mental imagery in which to embed the to -be -remembered items 
have been very successful. (See Table i in the Appendix) 

Bower (1972) demonstrated the power of student-generated mental imagery 
for recall in verbal learning laboratory tasks. Raugh and Atkinson (1974) 
confirmed this effect for vocabulary learning in several studies that bridged 
between the verbal -learning laboratory and the computer-aided instruction 
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environments. In a sense, these studies taay have been concerned with 
getting students to supply a specific relational network for some iso- 
lated nodes, words y or nonsense syllables. 

The problem for using this method in teaming technical subject- 
matter is that the material to be taught has its own, formal relational 
structure , and that remembering these relations often is more important 
than remembering the nodes in the network. The students need somehow to 
incorporate the formal Rational structure into their own semantic net- 
works* This may require that they generate mental imagery about these 
formal relations* Often, such relations are expressed as highly abstract 
mathematical formulas or equations, or in almost equally abstract circuit 
diagrams . Perhaps "seed imagery," in the form of external visual analogies 
could be provided to the student to assist him in generating appropriate 
mental imagery* On the other hand, perhaps verbal description, if rich 
or concrete enough, could evoke imagery in each student that would serve 
to structure additional self-generated mental imagery* It may be that 
abstract concepts, once described in understandable verbal terms, become 
tied Into the student's existing semantic network in long-term memory and 
are remembered because of these ties, without the necessity for external 
visual analogies. 

Inducing imagery, and other procedures which require the student to 
really process the material, seem to result in better learning and reten- 
tion* Anderson's studies of orthographic, phonological, and semantic 
processing indicated that a learner must "semantical ly encode" verbal 
material at the time of input if it is to be later available in long- 
term memory (Anders on f 1*171, 197 J) . Semantic encoding means bringing to 
mind "meaningful representation for words," (Anderson, 1971). The other 
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levels of processing alone may not result In the material entering long- 
term memory storage. Orthographic processing refers to the perceptual 
encoding of the physical features of the words and has a very short 
memorial life. Phonological processing involves encoding the acoustical 
properties of the words (speech), which enters short-term memory* 
Handler and Worden (1973) experimentally confirmed the common observa- 
tion that material can be adequately processes at the time of input yet 
be unavailable for subsequent recall as in the case of skilled typists 
who can rarely recall the content of material typed, although they pay 
attention to such features as grammar, punctuation, etc. 

Where possible facilitory effects of interactive computer graphics 
for learning and remembering meaningful material are to be studied, it 
is essential that tests be sensitive to effects of different processing 
levels. Computer graphics might be more memorable than verbal statements 
at the level tested by recognition tests, but this might not hold for 
tests of semantic processing. 

Although the literature indicates that Imagery is a potent facilitator 
in some laboratory learning situations, less support exists that imagery 
functions as a facilitator in more complex learning situations. However, 
literature concerning the reported use of imagery in complex thinking may 
help clarify the possible use of imagery in teaching complex subject- 
matter. Probably mankind's greatest thinker, Einstein, reported his re- 
liance on mental imagery during thought rather than on words or language 
(Hadamard, 1945). Kebule discovered the benzene ring through a vision 
of a series of linked atoms biting its tail like a snake (Beveridge, 1957). 
Michael Faraday, the father of field theory, "visualized" the electric 
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and magnetic lines of force (Araheim, 1969). One contributor of in- 
ventive ideas who holds some 97 patents diu>a study oi creativity in 

r 

his co-workers at a large Industrial research institute. He concluded 

that creative persons have the ability to visualize infhe area in which 

they are creative. Ke reported that, . . inventors with whom l have 

talked report thinking visually about complex mechanisms" (Walkup, 1963). 

He described in detail, the mental processes of creative electrical engin 

eers in thinking about Ohm's law: ./ 

They seem Co be able to produce a vivid, almost hallucinatory, 
vision and ffeeling about something like a fluid stuff, trying 
to flow through a solid stuff which opposes the flow, and they 
feel that the harder the electrical a tuff is pushed, the more 
rapidly It flows through the resistance opposing its movement. 
Furthermore, the electrical stuff is kept within bounds. The 
bits of stuff that' resist the flow cf the current are mentally 
combined in various ways, for example, so that the current 
must flow through a number of them in sequence, or so that 
it can split up and flow through any one of a number of them in 
parallel. This vivid and man ipula table image system of the 
fiow 4 of electrical currents has to bn elaborated considerably 
when current must flow through inductances and capacitances 
but this can be done with the same success, to the final 
result that one is able to perform a myriad of mental experi- 
ments in a very short time. 

(p. 37) 

These reports from outside the field also can give us valuable infor 
mat ion on the nature and process of imaging. In the stucy cited earlier 
by Walkup (1965), where a r umber of creative inventors were interviewed 
and studied, visual thinking was described as "almost a feelin g like the 
object being visualized." William Cordon, a psycho legist- inventor, 
investigated several successful mechanisms, called direct analogy and 
personal analogy, for understanding complex processes* The latter type — 
personal analogy*- involves an individual's empathetic identification with 
the situation under contemplation until "new visual images grow out of 
the identification process 11 (Gordon, 1963), 
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Although Gordon's work was primarily aimed at delineating and ex- 
plicating the creative process $ his work holds relevance to the issue 
of toggery's role in complex learning situations. The techniques that 
he taught his subjects to use for delving problems cretively are called 
personal analogy, direct analogy, symbolic analogy, and fantasy analogy. * 
These are techniques for inducing students to generate imagery. Applied 
to learning, these techniques of generating representational images evi- 
dently were facilitative; Gordon's students did achieve positive results 
by using imaginal techniques to understand difficult concepts in 
science. 

Hayes (1973) found that college students in mathematics reported 
using mental imagery ir. the solution of elementary mathematical problems. 
In his studies, the subjects integrated th*» experimenter- supplied image 
with their own to create what he termed a "hybrid image" during the problem- 
solving process. 

Establishing the value of external imagery and discovering the rela- 
tionship between internal and external imagery is important if we are to 
Justify using interactive graphic terminals. It is not, however, an 
either-or proposition. Language is indispensable for communicating about 
complicated subject matter. Visual analogies may represent aspects of 
that subject matter, but they cannot communicate all the relations that 
language does co-,«mui 1 icate so efficiently. A "pure" external imagery eru- 
dition is difficult, if not impossible to achieve. At least some language 
is necessary. Therefore, research on the effectiveness of external imagery, 
say, interactive animated graphics, must take this complication into account. 
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III. INTERACTIVE COMPUTER GRAPHICS FOR 
ILLUSTRATING INVISIBLE PROCESSES 

It could be said that science deals with the unknown by translating 
it into the invisible: quarks, hadrons, electrons, atoms, energy bands, 

4 

gravity, ether . . * Although mathematics is the language of science, 
there are many occasions for teaching about science and its technologies 
to mathematically unsophisticated students. This is a common requirement 
in the military services, where essentially temporary personnel must be 
initiated into the mysteries of fantastically complex weapon systems* 
The austere beauties of mathematics may fire the imaginations of profes- 
sional mathematicians, but the high school graduate who finds himself in 
the Service, struggling through some watered -down engineering course in 
electronics, is not likely to find these abstractions so stimulating. 

The interactive graphics capability of a computerized educational 
system such as Plato W would seem to be an ideal medium for reducing the 
austerity of these abstractions with animated visual analogies of invisible 
processes. Recognizing that the "true picture" of these processes does 
not exist, visual analogies might be used similarly to the way verbal 
analogies are used: to illustrate processes in more familiar, albeit 
highly simplified, terms. But unlike verbal analogies, animated illustra- 
tions can quickly communicate the nature of changes in events that might 
require long complicated verbal descriptions to explain. 

The touch panel accessory for the plasma panel terminal is an extremely 
convenient way to implement the interaction between student and graphics. 
The student 1 s pointing responses can be sensed and that information can 
be used by the program to control what is subsequently displayed. 
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Basically through this means, the student can be required to actively 
process information and his attention can be directed to that area of 
the screen containing the information that is to be actively processed. 
It is apparent that what actually goes on in such interactions, in terms 
of human information processing, is complex, subtle* and poorly under- 
stood. It would seem to be all too easy to program interactions that would 
not induce the right levels of processing after all. If the student's 
task calls only for perceptual processing, in Anderson's terms, then it 
would be surprising if the student did well on subsequent tests of seman- 
tic processing* Or, the graphical characteristics of the visual analogy 
on the screen could fail to stimulate the right semantic processing. For 
one thing, as Norman, Gentner, and Stevens (1974) demonstrated so well, 
there must be a substantive context » 

Providing appropriate and valid external images that will stimulate 
the proper cognitive processing is important* Langer (I960) distinguished 
between ordinary pictures and this kind of external imagery, which che 
called logical pictures: 

A "logical picture" differs from an ordinary picture in that 
it need not look the least bit like its object * Its relation 
to the object is not that of a copy , but of an analogy ,, 

The dissimilarity in appearance between a logical picture 
and what it represents is . . . marked in the case of a graph. 
. . . The graph is spatial, its form is a shape, but the series 
of events does not have shape in a literal sense* The graph 
is a picture of events only in a logical sense; . • . Most of 
i's have no difficulty in seeing an order and configuration of 
events graphically; yet the only form which the graph and the 
events have in common Is a logical form. They have an analogous 
structure, though their contents are more incongruous than 
cabbages and kings. 

This kind of external image may be described as a set of propositions 

about the subject-matter, stated in visual terms rather than verbal. It 

is a pictorial abstraction which visually symbolizes the critical (as 



ERIC 



-21- 



beaker, electrodes, connecting wire, light bulb, water and chemicals ~ 
are provided for the student. His task is to construct a battery by 
assembling the electrodes in the beaker, wiring them with the light bulb, 
pouring in the water, and then adding the chemicals. All of this is 
done using the touch panel to make objects appear on the screen at appro- 
priate places. The student then "activates" the electronic and chemical 

* ■ ■ , • 

reactions, one-by-one, by touching spots, indicated by a flashing arrow, 
on the plasma panel. The student's attention is directed by the flashing 
arrow and the semantic processing is defined by the questions and other 
instructions the student sees on the plasma panel. When the student has 
serially activated all the processes in the battery, all these processes 
then are turned on again and are allowed to run concurrently, so the student 
can observe that this is an analogy to what would be happening in a "real" 
battery. 

The following "before" and "after" pictures illustrate the nature of 
these interactions, without showing the actual movements of symbols for 
ions or electrons or for the flow of current. Important concepts are 
conveyed by the type of movement and animation. For example, current 
flow is shown not to be the flow of specific electrons, but rather the 
transmission of movement from one electron to another. 

The experimental design in fuil detail and other particulars of the 
first study will be described in a subsequent report. Basically, it in- 
volves comparisons between mixed interactive graphics and verbal, and 
"pure" verbal conditions, and between no context (serial lists) and con- 
text (as described above) conditions on several retention # tests designed 
to be sensitive to the effects of different processing levels. 
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Figure 2. Title page of lesson. Student responds accordingly. 





Figure 3. Title page. Following appropriate response, the following 
chemical reaction is animated: 

Zd* + ZCl^ZnClg 
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Figure 3. Title page. Following appropriate response, the following 
chemical reaction is animated: 

Za"^ + 2Cl=-»ZnCl 2 
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Figure 4. Before response, the student sees a model of the battery 
with a non- ionized zinc molecule on the anode. 
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Figure 5. Close up of display before response* 




Figure 6. After response, the zinc Ionizes leaving two excess electrons 
In the anode, which then shows the effects of corrosion. 
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Figure 7# Before response, a dot representing the salt ammonium chloride 
(NH4CI) is about to drop into the water* 
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Figure 8. After response, the molecule- NH4CI appears and drops into the 
liquid ionizing immediately into Nil, and CI' 0 



IV. SUMMARY 



Soau* current theorizing about internal and external, digital and 
analogue representational systems was reviewed. The possibility that 
there are two, overlapping internal analogue representational systems, 
one Cor organismic states and the other for external world dimensionali- 
ties and objects was considered. The concept of a working memory, or 
"mind's eye", and its importance in learning was described. Some concep- 
tions of how this might serve in the generation of mental imagery from 
digital propositions! information stored in long-term memory were noted. 

Some research bearing on the use of external imagery for facilita- 
ting learning and improving retention was reviewed. A project to use 
the Plato IV system for automatically running subjects and collecting and 
analyzing data anywhere in the Plato IV network was described. Illustra- 
tions of how the plasma panel display and the touch panel is used for 
interactive, animated computer graphics to illustrate invisible processes 
were presented. Description of the experimental design In detail, and 
results of the first study will be presented in n subsequent report. 
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